Cost-effectiveness analysis of two-way texting (2wT) intervention to improve ART retention among newly-initiated antiretroviral therapy clients in Malawi.

Background: Retention in HIV care is crucial for improved health outcomes. Malawi has a high HIV prevalence and struggles with retention despite significant progress in controlling the epidemic. Mobile health (mHealth) interventions, such as two-way texting (2wT), have shown promise in improving anti-retroviral therapy (ART) retention. We explore the cost-effectiveness of a 2wT intervention in Lighthouse Trust's Martin Preuss Center (MPC) in Lilongwe, Malawi, that sends automated SMS visit reminders, weekly motivational messages, and supports direct communication between clients and healthcare workers. Methods: Costs and retention rates were compared between 2wT and standard of care (SOC) for 468 clients enrolled in each. Incremental cost-effectiveness ratios (ICERs) were calculated. Scenario analyses were conducted to estimate costs if 2wT expanded. Results: The 2wT group had higher retention (80%) than SOC (67%) at 12 months post-ART initiation. For 468 clients, the total annual costs for 2wT were $36,670.38 as compared to SOC costs at $33,458.72, resulting in an ICER of $24,705. Among scenarios, the ICER was -$105,315 if 2wT expanded to all new clients (2678 at MPC and -$723,739 as 2wT expanded to other four high-burden facilities (2901 clients), suggesting high cost savings if 2wT was effectively scaled. Conclusion: The 2wT intervention appears cost-effective to improve ART retention among new ART initiates in a high-burden ART clinic. While mHealth interventions have potential limitations, their benefits in improving patient outcomes and cost savings support their integration into HIV care programs.

Centering healthcare workers in digital health design: Usability and acceptability of two-way texting to improve retention in antiretroviral therapy in a public HIV clinic in Lilongwe, Malawi.

New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low- and middle-income countries, like Malawi, appropriate digital health applications (apps) must fit into local clinic, connectivity and resource constraints. We describe the human centered design (HCD) and development process of an open-source, hybrid, two-way texting (2wT) system to improve ART retention. We detail the critical role of diverse healthcare workers (HCWs) in the HCD process to inform app usability, create buy-in, and ensure appropriate optimization for the local context. We optimized 2wT usability and acceptability over three HCD phases: 1) informal feedback sessions with diverse 2wT stakeholders, 2) a small pilot, and 3) key informant interviews. Phase one included four sessions with diverse HCWs, including "expert ART clients", clinical, technical, supervisory, and evaluation teams to inform 2wT design. In phase 2, a small pilot with 50 participating ART clients aimed to inform implementation improvement. Phase three included interviews with ten HCWs to deepen understanding of 2wT acceptability and usability, documenting strengths and weaknesses to inform optimization. Multi-phase feedback sessions with HCWs helped refine 2wT language and message timing for both weekly and tailored client-specific visit reminders. The pilot led to improvements in educational materials to guide client responses and ease interaction with HCWs. In interviews, the HCWs appreciated the HCD co-creation process, suggested ways to increase access for low-literacy clients or those without consistent phone access, and felt integrating 2wT with other eHealth platforms would improve scalability. Inclusion of HCWs across phases of HCD design, adaption, and optimization increased 2wT usability and acceptability among HCWs in this setting. Engaging HCWs into 2wT co-ownership from inception appears successful in co-creation of an app that will meet HCW needs, and therefore, enhance support for 2wT clients to attend visits and remain in care.

The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: findings from a quasi-experimental study in Lilongwe, Malawi.

Background: Retaining clients on antiretroviral therapy (ART) is challenging especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi. Methods: Between August 2021 - June 2023, a quasi-experimental study compared outcomes between two cohorts of new ART clients: 1) those opting into 2wT with combined automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as "the proportion clients ≤6 months of ART initiation eligible for 2wT". 2wT effectiveness was assessed in time-to-event analysis comparing Kaplan-Meier plots of 6- and 12-month retention between 2wT and SoC using a log-rank test. The effect of 2wT on ART drop out was estimated using multivariable Cox proportional hazard models, adjusting for sex, age and WHO stage at ART initiation. Results: Of the 1,146 clients screened, 645 were ineligible (56%) largely due to lack of phone access (393/645; 61%) and illiteracy (149/645; 23%): a reach of 44%. Among 468 2wT participants, the 12-month probability of ART retention was 91% (95%CI: 88% - 93%) compared to 75% (95%CI: 71% - 79%) among 468 SoC participants (p<0.0001). Compared to SoC participants, 2wT participants had a 62% lower hazard of dropping out of ART care at all time points (hazard ratio 0.38, 95% CI: 0.26-0.54; p<0.001). Conclusions: Not all clients were reached with 2wT. For those who opted-in, 2wT reduced drop out throughout the first year on ART and significantly increased 12-month retention. The proactive 2wT approach should be expanded as a complement to other interventions in routine, low-resource settings to improve ART retention.

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

BACKGROUND: Early retention of people living with HIV (PLHIV) in antiretroviral therapy (ART) programs is critical to improve individual clinical outcomes and viral load suppression. Although many mobile health (mHealth) interventions aim to improve retention in care, there is still lack of evidence on mHealth success or failure, including from patient's perspectives. We describe the human-centered design (HCD) process and assess patient usability and acceptability of a two-way texting (2wT) intervention to improve early retention among new ART initiates at Lighthouse Trust clinic in Lilongwe, Malawi. METHODS: An iterative HCD approach focused on patient and provider users' needs, incorporating feedback from multidisciplinary teams to adapt 2wT for the local, public clinic context. We present mixed-methods usability and acceptability results from 100 participants, 50 at 3-months and 50 at 6-months, post 2wT enrollment, and observations of these same patients completing core tasks of the 2wT system. RESULTS: Among the 100 usability respondents, 95% were satisfied with visit reminders, and 88% would recommend reminders and motivational messages to friends; however, 17% were worried about confidentiality. In observation of participant task completion, 94% were able to successfully confirm visit attendance and 73% could request appointment date change. More participants in 4-6 months group completed tasks correctly compared to 1-3 months group, although not significantly different (78% vs. 66%, p = 0.181). Qualitative results were overwhelmingly positive, but patients did note confusion with transfer reporting and concern that 2wT would not reach patients without mobile phones or with lower literacy. CONCLUSION: The 2wT app for early ART retention appears highly usable and acceptable, hopefully creating a solid foundation for lifelong engagement in care. The HCD approach put the local team central in this process, ensuring that both patients' and Lighthouse's priorities, policies, and practices were forefront in 2wT optimization, raising the likelihood of 2wT success in other routine program contexts.

Centering healthcare workers in developing digital health interventions: usability and acceptability of a two-way texting retention intervention in a public HIV clinic in Lilongwe, Malawi.

Background: New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low-resource settings, like Malawi, appropriate digital health applications must fit into local connectivity and resource constraints. Target users' perspectives are critical for app usability, buy-in and optimization. We describe the formative stages of the design of a two-way text-based (2wT) system of tailored reminders and adherence messages for new ART initiates and share results from key informant interviews with HCWs focused on app usability and acceptability. Methods: Using a co-creation approach with clients, clinical, technical and evaluation teams and over app development, we held four informal user feedback sessions, a small pilot with 50 clients, and ten key informant (KIIs) to deepen our understanding of healthcare workers (HCWs) needs, acceptability and usability. Results: Formative research informed the design of interactive client-to-HCW communication, refining of the language and timing of weekly text blast motivational messages and tailored client-specific visit reminders. Informal feedback from HCW stakeholders also informed educational materials to enhance 2wT client understanding of how to report transfers, request visit date changes and ask questions related to their visits. In KII, HCWs noted their appreciation for the co-creation process, believing that the participatory HCD process and responsive design team enabled the development of a highly acceptable and usable 2wT digital tool. HCWs also suggested future improvements to promote inclusion of clients of varying literacy levels and economic backgrounds as well as integrating with other health platforms to improve uptake of 2wT. Conclusions: Inclusion of HCWs increased perceptions of app usability and acceptability among HCWs. HCWs believe that 2wT will improve on-time ART visit attendance and provide valuable early retention in care support. The co-creation approach appears successful in designing an app that will meet HCW needs and, therefore, support client adherence to visits.